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ABSTRACT 



- “ - Individuals or groups interested in conducting r - 

follow-up studies of foraer students should find this docuaent 
helpful. A follow-up study is a procedure for accunulating pertinent 
data from or about individuals after they have had siallar or 
-comparable experience. Generally the follow-up study should obtain 
inforBation which assists in deteraining the extent to which 
objectives of <»the systea have been set. Dateralning the procedure and 
rhe groups to be used is discussed. Also, rhstruaentation, locatxng 
respondtiats, and organizing for the study are areas of concern. 
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^ ■ preface" ; 

^ ^ ■ 

'UhJLs plibllcatlon was praparat^ to msi^t those Individuals and groups 

interested in conducting follow-up studies of former students. Like many other 
fields^ the procedures and techniques considered successful in conducting 
fol3ow-up studies today may likely be educational historical relics tomorrow. 

We encourage you to keep abreast of the -latest successful follow— up procedures. 

^ Many of the practices recommended in this publication have been found 
successful by many researfehers! . Our own e^erience in using the recoinineuded 
procedures largely relates to our di.rection of the Central Kentucky Vocational 
Education Evaluation Project. 

Floyd L « McKinney 
(^tarlea Oglesby 
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DEVELOPING AND CONDUCTING 

FOLLQW-UP STUDIES OF FORMER STUDENTS 

\ 

The focus of n»st evaluation efforts should be on the product or the out- 
coines of the educatiopal system. This emphasis on the output of the educational 
system means that we. need to look at '^the former students of that syst^ to as- 
sist in determining the effects of the educational system on the former students, 
One of the ways of securing Information about former students is to conduct a 
follow-up study of the former students. 

WHAT IS A FOLLOW-UP STUDY? 

A follow-up study is a procedure for accumulating pertinent data from or 
about individuals after they have had similar or comparable experiences. It is 
important to remember that follow-up implies the collection of data about some- 
thing 'idiieh has already taken place. In other words students are asked to re- 
flect back on how the* program In question either prepared him or failed to pre- 
pare bljn for his future work. ^ should^ he remembered that follow-up studxes 
are not the complete anWer for evaluating educational systems. They are but 
one important component of a larger design for evaluating the educational 



endeavor . 



WHY GONDUCTy^ FOLLOW-UP STUDY? 



The decision ,whethe,r or n^t to conduct a follow-up study must evolve from 
the ebjectivaa of the' total, ^aluation’ effort ^ Once these objectives have 
been determined, one cap t^n; proceed to identify the kinds of Information heed- 
ed to answer thd questions rais^ by the educational pro^am objectives. Sev- 
eral techniques and pryedures may 1;e necessary to get the needed Information. 

A former student fol^6w,-u^ study may be one of the selected procedures for in- 
formation gathorli^g. 5 
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PURPOSES OF THE FOLLOW-UP STUDY 



I 

Generally the follcw-up study should ot ;aln Information '^Ich assists In 
determining the extent to ^leh the objectives of the educational system are 
being met. There are Other "side effects" and these are discussed later in 
the paper . 

In most cases the follow-up stud^ will be in the nature of a self-survey. 
As such the follow-up study may produce benefits heyond that of data collection 
and analysis. It can act as a motivatl^HErfceT-f^ change. 

The follow-up study is more closely concerned With the "eonsnunity within 
a community" - that of the educational system. The school sysi;em includes 
teachers, school administrators, students, parents, the board of education and 
(hopefully) vocational education citizen advisory conplttees, all of whom have 
a vested Interest in the outcomes of the educational system. Since so many 
groups and individuals are involved, the follow-up study has the potential for 
uncovering conflicts which may be existent in the .overall educational coirou- 
nity. In some cases a follow-up study (or most precedures or techniques used 
in evaluation) may be seen as; a threat to individuals or to particular pro- 
gf ams . At the very ’®aet, a follow-up study will probably Indicate areas re- 
quiring change of &oim am't - addition of new prograina, deletion of others or 
revision of existing prograiwi. Groups or Individuals closely associated with ; 
program^ \d-ilch are identified as those requiring change will naturally be most 
affected by the results of the follow-up. It Is, therefore, exceedingly Im- 
portant that all interested parties he actively involved In the follow-up study. 

Wormser and Selltiz note the li^ortance of bringing about change by In- 
volving the ecranunity in a self-survey. Their following cOTwients are appli- 
cable to follow-up studies. 
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The belief that a C(snmunity self^survey can lead to change. In the 
coi.anunity is based on the following ass%iniptlons : ;r(A) Individuals 

who participate in an undertaking tend to become ego-involved in it* 

In a fact-finding project j such ego-ihvolvaniant is likely to take 
the form of a sense of personal responsibility to do somthlng about 
the situation which one has helped to diseovar , . * if those situa* 
tions do not conform to ganaifal standards of aquitabj.e socla.1 rela^ 
tlonships. (B) , Group membership ^(and respondents .are members of the 
group) reinforces individual conmiitment and provides support for 
individual behavior with the result that people who may lack cour- 
age or skill to work by themselves toward changes which they believe 
to be desirable are able to undertake constructive action members 
of a group. Through its use of working committees and other oper- 
ating groups, the self-survey brings to bear these group membership 
effects, (G) In any aelf-survey focused on problems^ over which 
these are ‘misundaf standliiga or apparent conflicts of interest between 
sub-groups in the conmiunityj the experience of members of these var- 
ious subgroups in working together on a study of the coiranon problems 
may in itself help to change attitudes wh^‘ch have contributed to the 
problem.^ 

In regard to the whole population of former students , follow-up serves 
a very useful purpose in -eliciting evaluative respoKtees from former students 
reflecting the success of the vocational education program in preparing them 
for eroplo3nnent. Important infbtmation is found in answer to such questions as: 

1, What training received ^as important to them? 

2 , What training was unimportant? 

3, What suggestions for Improving the Job preparation programs do 
they have? 

This kind of Information is of an advisory nature and has some limitations be- 
cause respondents generally have a ilmited kniDW ledge of alternatives , and each 
reapondant reacts out of a different frape of referepce^ 
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A common purpose for which ^follc^-up studies hav^been used is to make 
program comparisons. Comparisons have been made of vocationally trained grad^ 
uates versus non-rvopatlonally trained graduates on measures of Job satlefactipnp 
earning, and job stability, The^e is great danger of gross error in such 



^Margot Haas^ Wormaer and Claire Selltlg, »'Cdnmiunity Self-Surveysi 
Principles and Procedures ,*^ Re s edreh He thod s . in S oc in I H e la t ipns (l^ow -Yiirk ; 
The Dryden Press, 1957), p* 611. T ^ ~ 
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comparisons because of differing objectives for different programs and the ■ ^ 

■ ' ■ ^ 

characteristics of the studants in the program. 

Some of the specific uses for a follOT^up ^ study include* . ^ 



1 . 

2. 

3. 

4 . 

5 . 

6 . 



Emphasizing the primary objectiyas of vocational Educations 
Show^ing evidence of services provided by the vocational education 
program, . " 

Shoeing effectiveness of vocational education programs. 



"\ 
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Determining evideiice of placement and heed for training, 

Revealing a need to bring about an improvement in the placement of 

» -c 

graduates. 

Assisting in upgrading the public image of vocational education, 



' 7. publicizing purposes at the state and/or local level, 

r' .. m 

8. ( Securing information for state -wide meetings of local directors 
and supervisors to focus attention on: 

I a. Employment and placement trends, ^ 

b. Reasons for good or poor placement, 
f? c. Programs with n^rginal value, and 

d. Causes for lack of completion of training, 

9* Determining the need for establishment, consolidation and/or -‘v 
limitation of training oppoftunities in certain program areas, and 
10. Providing information helpful in Identifying strengths and weak- 
nesses in local programs. • ' 

INVOLVING SIGNIFICANT GROUPS IN FOLLOW-UP STUDIES 

The, Counseline Service ) ^ 

The counseling service In the school s' em should be the agency most In 

terested in thd results of an evaluation effort. For the student, counsel'irtg 

■ • ■ ’ ■ / 

l 3 rke primary area in which c ommun ity employment needs and the aptitudes /and 
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personal desires of the Individual come together* The coiinseling spirvice can . -s 
help in matching student desires and aptitudes with available jobs in the cotti;- 
' tnunity or can point the way to desired training and occupation outside the 

“ j ■ 

innnediata conmiunity, ’ ‘ - 

The student needs to' know how-^he stands in relation ;to employment oppor- 
tunities. If the student, for various reasons, must, remain in the imroedlate 
area in his pursuit of a career, he is entitled to know w^at jobs are ^available 
(or will be available in the future) and tfife" training he ijill need t9 secure . 

. a job. He is also entitled to know How well the educational system will ^prepare 

him for a Job. ‘ , I ^ ^ 

. If the student • s personality, charaoteristics ' and aptitudes do not coincide. * 
with the educational and occupational environments of- the local conuounity (and 
‘he has the mean's to relocate), he is entitled to counsel Itig which will point him 
in the desired direction. 

The results of a‘ carefully planned and executed follow-up in conjunction 
- with other aspects of evaluation will provide background inibrmatfon for pro- 
ductiva voeationaL^ounseling. The -follow-up study provides ■ Information of most 
immediate concern to th^student since ft is derived irbm those former students 
* who have already completed studies in a curriculim in which he is Involyyt^ 
interested. ^ ^ ' . - • . 

The school counselor should be inplu^ed in all phases of evaluation -- . 
planning, executing, analyzing, and translating ri»^ults into progra^ modlfiea- - 
tions. The counselor,, perhaps than anyone else In the school system, -should 

be aware of the personality Crrfits, haste aptitudes, desires for. the future, and 

academic potential of the^tudent body. The school counselor Is the logical per- 

• “ ' - , , , 

son to participate in the formulation of objectlvfes for a follow-up survey. He 

9 t, • - 

is* also vital to the selection of groups to be surveyed, the type' of data to be 
obtained, and most certainly in ^the construction. of questionnaires to be 
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.iuii, .ASterad. In additi^ to the personal characterigWds of former students 
che eouti^plor should be cognizant of tho soGlo~cultural patterns prevailing in 
the eoimirmiity . He will be able to advise concerning the best potenti4l ap- 
oroach to former students in the selection of questionnaire format and— wording 
of cover letters to insure that the content is pitched neither too high nor 
toe IcTw- for the intellaG,^! capabilities of the respondents. ‘ 

When, the former student questionnaires have been returned, the counselor 
can be very helpful in the analysis and presentation of data. He will need to 
ori-ng rnr,o play all his tact and experience in the presentation of data to pre- 
clude misunderstandings. Follow-up studies are designed to help both students 
and educators and not to provide anmunltion for departmat^ai^^rfare . 

The follow-up study will do more than provids data direGtly for indivi- j 
dual aud group counseling. In conjunction with data from other evaluation 
activities, results from the follow-up can be very useful in currlculim modi- 
fication or development. The c_qunselor should be included in these ende,avors^^^^ ' ^ 
because he is, after all, responsTble to teachers as well as students for help 
In designing courses for the student population. , , 

It may seem to the reader that a. disproportionate amount of emphasis has 
been placed on the role of the counselor in follpw-up studies. In truth, it 

is the opinion of the writers -that follow-up is pri ma rily a function.^ of the 

. ' - , ' ^ ' ^ ’ ■■■ ■■ ■ r 

counseling service. There is no intention, however, tp negate t^e role of other 

concerned groups or individuals. As previously stated, there - are others who 
should be Involved in the planning,' ptepaMtlon, and conduct of follow-up, studies, 

The Teacher : , ' _ . .. ' 

In any school the teacher has the most daily contact .W'lth the student.. He 
will have a "fee|.'* for general attitudes |n the classrocp and ma^r to 

^^nt to curriculum areas which seem to be ' successful or unsuccessful from the 
point of view of tbe-«tudent . The teaeherVwlli most likely have the confidence 
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of Ihost students and will receive feed-back from fo^er students and students 
currently enrolled. Since'. certain portions of follow-up require, classroom time 
.(orientation of students regarding the importance of follow-Up prior to leavin; 
school) it is, at the very least j a matter of courtesy to include the teacher 
in planning and conducting a follow-up. Because of the teacher's position, he 
is perhaps the most important person, in developing a positive attitude toward 
evaluation in regard to students and parents. 'The teacher can literally make 
or break the evaluation, effort ^ , 

The School Administration - / ■' 

The school administrator is ho less linp©|rtant to an evaluation effort than 
the teacher. In most cases the school principal can decide whether or no^ his 
school will conduct a follow-up study. TTie principal has an important role in 
deve loping a positive attitude toward the follow-up stqdy within the faculty. , 
He has the prerogative ef scheduling time to be spent on evaluation projects.. 
He can also allot office time and personnel to be utili^'ed. The school adminis- 
trator is vital in msiAtalning liaison bstwsan tlis sctiool and tli^ Boaxd of 
Bducation and b^twesn ths school and the State Education Agency. Seldpjn will 
an evaluation activity of any kind succeed without strong administrative eonmiit- 



ment to the effort. 

. V. 






The Student Copimlt tee 

It is a growing trend, and , a most r^^srding one, to include students in the 
formation of/p^ctiyes and plana. The student cOTmlttee can he helpful in 

pinpointing curriculum areas in need of review. The student committee should 

* ‘ 5 ' ■ ’ . ' ■ ' . . • 

certaln/iy be included In the selection or c6nstructidn of follow-up Instru- 






ment^ so that tjioy will be 



relevant to St udehts. Students currently enrolled 



i' ‘ 



/ 



can help locate fr,ietrds whck^are former students . In s^e follow-up studies - 

■ ^ ' ■ ■ f ' ■ . ■ I ■ , ’ ■ 

/meinbers of the student cominittee have ai^d project directors in admxnistering 



questionnaires to special education students and have been Involved in mailing. 
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procedures, compiling data, analyzing data and formulating recotmiendations , 
The mere fact- that students are Included In meaningful aspects, of the follow- 
up should go far In "selling" the study to the student body. A positive atti- 
tude on the part of students is necessary to insure that valid data will be 
2 ' 

obtained a 

The Board of Education and the Vocational Education Cltlaen s * Advisory 
Coirolttae 



i^of great Importance to inv^e citizens in an active capacity in the 
follow-up study. It is fully recognized that the advisory committee does not 
have tHe legal function of the board of education. However, the fact that both 
organizations are composed of members of the community is most important to the 
success of the follow-up. The members of these groups will be able to obtain 
feed-back from the community regarding the pr^airation of students for employ- 
ment. They will, in many cases, be the employers-'of graduates from the school 
system. In addition, individual rnmbera can survey other employers in the same 
(or different) fields of business. Citizens committees should be included in 
the construction of questibnnaires to he submitted to employers - those question- 
nairas which are designed to elicit information concerning the qualify of stu- 
dent preparation for employment . The Board of Education should make the final 
decision regarding the partidipatlon in a study of the local educatpnal 

system, ' 

Is certainly not exhaustive listing of groups to be Included in a 

follow-up study or the functions of these groups. Each schooi system is unique 
and the sources of aid ajid^lrifoinnatlon within conmiunity Will be determined 

by the overall objecjl^es of 'the school system an^ the objectives ^of the/^ollow- 
Up ^rtiuiy* 
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2poj. further information regarding the use of sftudent committees in , 
e^luating educational programs see the Final Report of tl^ Kentucky 
-t^cwtlonal Ed ucation Prelect . LeSrlt^on; saaCU, CoUf 

Ttrhlverfti't'y of KentucKy, 1971 . 
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DETERMINING THE FOLLOW-UP PROCEDURE 

The mall follow-up Is most frequeatly used. The problem of nonrespondents 



is a major shortcoming of the mail follow-up procedure-. In a Wisconsin study 
with a 46.9 percent response,, it was discovered that 78 percent of the former 
students in the top percentile of their class returned the questionnaire, while 
only 23 percent frc^ the bottota percentile returned questionnaires. In a study 
in Arkansas, five rhlcal SjChools conducting mail surveys did not receive any 
completed questionnaires from former students who had left school prior to grad- 
uation. If our evaluation effort la to be successful we will have to obtain 

feedback from Si 1 whom our programs are designed to serve and not just our suc- 

j 

cessful graduates. Therefore, again it must be emphasized th^t the respondents 
must be made to feel that they are valuable members of the '^^group . " 

One approach to follow-up which has proven successful Is the Interview 
technique, either in person or by phone. Personal Interviews ate probably the 
most desirable' kind of follow-up because they provide the opportunity to ask 



questions of clarification which may provide deeper Insight into the problems 
of occupational.^ preparation as percleved by the former students . Personal In- 
terviews can be very expensive and require a great Miopht of staff time. The 



ralephone interview can be — effectively used on a sampling basis. One. is limited 
on the amount of information which can be obtained, but the telephone inter- 
view may be the only workable procedure for- some segments of the populatlpn. 

The following factors should be considered In determining the best follow- 
Up procedure to use; 



1. What kind of data are needed? 

2. How much data are to be obtained? 

3. Wliat are the sources of data? 

4. How mucli— t-hnie is avai lable? 
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5 . What is the size of the group or groups to be studi^? 

6. How much money is available? 

7. What is the availability and compatency of the staff? 

Schools planning their first occupational follow-up study should seek the 
assistance of a consultant. Small scale studies done frequently are often 
more helpful than studies of larger scope done with long lapses of time between 
them. 

DETERMINING THE GROUPS TO FOLLOW-UP 



There must be an accurate and cOTHpleta definition of the group or groups 
to be studied. If the wrong people supply tl data, the resulv^.s will hot be 
valid. Surveys may be organized to cover a single occupation, several occupa- 
tions in a single field, or to cover all the fields in which the school offers 
occupational studies. In the past most follow-up studies have been laade of a 
single occupation or oeeupatlonal field. However, in order to achieve a pic- 
ture of the entire system all former students, general curriculim ■’c well as 
vocational education students, should be Included in foliow-up studies. 

Xf the picture of the total edueatlonal effort Is to be realistic the 
follow-up study mJat Include students who did not graduate as well as those who 
did graduate, ii^ some schools the dropouts comprise a rather sizeable pro- 
portion of the classes, which, if ignored , could result In providing misleading 
findings. In examining the procedures for cotuiucting the follow-up study 
(dlseussed later In this paper) i keep the dropout in satnd. Perhaps, a different 
approach should be made to the dropout - a different form of letter and ques- 
tionnaire or even a different/ type of survey, such as the Interview. It is of 

^ ‘ ' 
great Importance to make the /dropout feel that he %s a vital part of the /follow 

Up populatioii. , ' * ' 

Only those out of schbol for a year or more should be included in a 
follow-up study. Former students being followed-up sbould-^ave been out of 
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school a sufficient length of time to be able to reflect on the relevance and 
helpfulness of their previous educational experience. A problem very difficult 
to cope with centers around the fact that the longer former students have been 
out of school the greater the problem of separating tht value of the educa- 
tional experience from the Influence of noneducational activities. Also, the 
longer they are away from school the lass valid their Judgments about the cur- 
rent educational program are likely to be. Schools have most often followed- 
up classes that have been out from one to two years or those out three to six 
years . 

Another very valuable kind of follow-up Is the trend study. This would 
involve a school making a study of at least two classes of former students at 
the same time. 

should you study all former students of a class or sample the population? 
Many schools have studied an entire class. However/ sampling techniques , when 
properly applied, will provide reliable and valid results. 

DEVELOPING THE FOLLOW-UP INSTRUMENT 

A major concern in doing follow-up studies Is the development of the in- 
strument. Developing a good foTlc«^-up Instrument can be a very difficult and 

tima” consuming task. . / 

Since the follow-up Instrument will probably be one of the primary sources 
of data used in determining if the educational system is fuifilllng its objec- 
^tlves. It logically follows that the InstroiMiit items shouldbe designed to 
gather information whlfeh will help to determine if the educatlbnal 
successful or should improve its programs. If our program objectives are stated 
in performance terms, the magn^ltude of our task Is somewhat reduced. Tlie pro- 
gram objectives beioine' Che stating the criterion questions and, con- 

sequently,' the follow-up Instrument questions. 

A criterion question Is merely one which states the objective in such a 
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way that an answer is crlled for which will help meaWre the attainment of that 
objective. Some program objectives will require statin^; more than one criterion 
question, while in other cases it may even be possible to davelop InstruBwnt itenjs 
without going through the intermediate step of stating a criterion question. Fol- 
lowing the statement of criterion questions, the next step is to develop or se- 
lect as many instro?,ient items as will be needed to obtain sufficient ihformatiqR " 
for answering the criterion question. An example of this process follows: 



PROGRAM OBJECTIVE; To provide students an educational program which will re- 
sult In a career that is satisfactory to the former student, 
fTBTTERIQN QUESTION 

To what extent did former students receive an adequate 
vocational education during their high school years? 

ITEMS FOR THE QUESTIONNAIRE 

1. Considering all of your occupational experiences sine# leaving school, 
how well do you feel your school prepared you? 



Well prepared 
Satisfactorily prepared 
Inadequately prepared 



1 . 2 _ 

1.3 



Please rate your former school frankly on the items listed below, 

H 



pa 



1. Quality of vocational Instruction 

2 . Quaility of academic Instwetlon . 

3 . Physical condlttton of school. . . 

4. Tekcher interest in students, , , 
Instructional materiaia and aids. 






M 



• . • 9 • V- 



5. 

6. Student counseling 

• ! ^ 

7. Preparation for job Interview . 

Job placement of students . . . 
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9. Ptactical application of training to job* , , * 
10. Reputation In community . • * * 



• * » * 
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To what extent did the school pr^are you to work with your ,j^eirvisors 
and fallow workers? 

Excellent preparation 12, 1 
Adequate preparation 12.2^ 

t 

borne preparation 12,3 

No preparation 12 .4 

Generally open-ended items should not be used. The reBpdnses to such 
questions are so varied that thdy are almost impossible to catagort? and sim- 
marize. However^ a foreed choice question can provide misleading ’ata 1£ it 
does not provide for all the alternative answers or space for the respondent 
to write in an answer. 



Serious questions should be raised when asking questions about demographic 
data. Usually Information relating to the fo.-tner students age, sax and address 
is in the school files. It needlessly increases the length of the questionnaire 



thereby Increasing the length of time needed to complete it if you ask for in- 
formation you already have, | 

-bet us consider some of the problems associated with frequently sought in- 
fonnatlon about present Jobsi held. Job history. Income and evaluation type iteras.- 

We are naturally interested In the present Job held by the former student, 
yjiat appears simple enough, but several knotty problems are associated with 
such an Item, In response to the question, "What is yodr job?" varied answers 
are usually given. These unidentifiable responses may be reduced by asking for 
a job title with sow exMiples and may be followed with a question, ' What do 
you do on this Job?" Even tHls presents two difficulties — the nature of the 



job description of .different .employers and the nature of the response. 

If a job history is to be obtained I a chdck should be^ made of the reported 



time elements. 
Girls frequently 



Does the amount of reported time tots! Co_the elapsed time? 
report "housewife" and" job" as c|termlnous fuli-t:lme 
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oecupatlons. Part-time employment may overlap full-time employment. Unemploy- 
ment is difficult to differentiate from "not interested in a job." 

Another problem involves the matter of income. Should It be obtained as 
hourly, weekly, monthly or yearly income? There Is a naturnl reluctance on 
the part of many respondents to report income, but is not so great that a high 
percentage fall to respond. If you are concerned that it will antagonize some- 
one, making the question optional seems to be'\a good strategy. Another approach 
is to place it last on the form. A respondent who has completed most of the 
form is less likely to quit at the last minute over such an item. 

Evaluation type questions are probably beat done with some index scale. A 
variety of conditions can Influence responses, such as^ the way the question 

is asked "How well did you like your vocational program?" Is a positively 

directed statement, "How did you feel about your vocational program?" Is a 
less positively directed statement. 

I NSTRUMENT FORMAT 

The follow-up instrument should be drafted into precise format and space. 

The items should ba organized by sections such as job related, educational, 
avocational, military service, self asseasment, and educational system. The 
Instrument items should be reviewed far comment by other persons who yre com- 
petent In the areas for which the data is required. 

The instrument should be designed for either keypunching, optical scanning 
or mark sensing. Be sure to check with the technologist where your instrument 
will be processed to determine the requlrCTents for instrument design. 

Appropriate length of the Instrument is an uncertain issue. However, it 
is generally conceded that the size of the instrument (number of items and the 
physical bulk) is Inversely related to response' rate. It Is also related to 
costs, through increased printing, mailing, and processing. 
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The loeahanical presentation of the inatru.,.ant Is very Important, You can 
almost guarantee poor response if it is mimeographed on paper. Renumber 

that the instrurnant will most lik|ely be arriving in the mail with varlaus ad- 

1 _ ' 

yertisemants which have all the expertise of Madison Avenue behind them^ 
tiess the colorfully lithographed '*opportunl ties'* for books, cameras, radios, 
building lots in Florida, and magazines at cut-rate prices (completa with certi- 
ficatas and coupons edged in gold). You will certainly not be able to compete 
with such high-prassure salesmanship, but you can make definite efforts to pre- 
vent the follow-up instrument from being discarded along with the junk mail. 

Some suggestions ; 

1. Colored paper tends to result in a higher return, 

2. ^ If the instrument is printed in booklet form, make sure the 

pages are numbarad in sequence (and don't stick together)* 

3* Make sure the printing is legible. 

4. Design the questionnaire in a size convenient for mailing, 

5. Almost anything you can do to maka your approach "different" 
will enhance the possibility of receiving a response. 

In other words do a professional Job of styling and be sure it looks like a 

serious instruniant with good face validity* 

PILOTAPPLfCATION OF THE INSTRUMENT 

The best way to deterniine if the quefetiormaijfe directions and questions 
are clearly stated' is to pre-te'st them to see If they can be understood and 
answered. Under the press of time this step is frequently overlooked or given 
only minor attention. Time given to pretesting can save hours of labor in sum- 
marising and significantly improve the response rate, reduci missing data and 
Increase the reliability of the instrument. The instrument should be pretested 
with in-school studants as well as .former students. Ask them to participate in 
the decisions concerning type of data to. be collected (which Includes objectives 




r 
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of the £ollow“-up survey) j typ^ of questions to be asked^ wording of the ques- 
tions, and designing the instrisnent (including physical appearance of the 
instrument.) ' 

PROCEDURES FOR CONDUCTI NO THE FOLLOW-UP 

A technique gaining in popularity is to sand a card or letter to the for- 
mer student prior to mailing the follw-up instruTOnt. The purpose of this card 
or latter is to alert the former student that he will soon be receiving an im- 
portant Instrument, which he is urged to complete and return as soon as possible 

i ' 

The following fiiaillng pattern is suggested at one weak intervals. 

First iQQaillng - ^*Alert*- card 

V- - 

Second mailing ^ follow-up Instrument, cover letter, and 

return anvelope -- stamped and addressed. 

Third mailing ^ first thank-you reminder card. 

Fourth mailing - second request follow-up Inst ’ment, second cover 

letter, and return envelope -- stamped and addressed. 

Fifth mailing - second thank you-reminder card. 

The cover letter should be brief, but indicate the purpose of the study, 
uses to be made of the findings, the importance of hearing from ayeryone in the 
class, a suggested date by which the form should be returned, and assurance of 
the confidentiality cdC the Information to be provided. An effort should be 
made to make the respondent feel that he is a part of the study. 

If at all possible, the cover letter Should be signed by a person whom the 
forn^r stedent will recognize and trust. This may be a school administrator, 
counselor, or a key faculty member who has worked closely with students and is ^ 

' ikely to elicit responses from them. Who can resist a letter that has 
bern personally addressed and signed as opposed to a greeting frcan a computer? 

Exanples of the types pf letter and cards to be sent are Included on the 
following pages. V 



m 



V 



V_/° 
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SAMPLE 



(School Letterhaad) 



First Mailing — "Alert” Card 



Date 



Mr. Joto Doe 

1414 Bluebird Avenue 



Any town, Kentucky lOlQl 

% 



Daar John: 



In the near future you trt.ll receive a queatiohnaire concerning your employment 
experiences since leaving our school.. I should like to request your coopera-^ 
tion by completing and returning the questionnaire* It is desired to aid in 
improving our progtams for preparing students fbr tile world of work. Your re^ 
sponsea to the questions will be of tremendous aid to us and the students now 
preparing for employiDent. * Your answers will be kept in strictest confidence# 



Sincerely, 



\ 



SupeElntendent of Schools or Teadher' 



• ( i 



. / 









" f 







i- 



* " ^ 



/ 

X ■ 



















./, '■ 



■\ 



SAMPLE 

Secoacl Mailing^ — Cover Letter 

(School Letterhead) ‘ 
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\ 



Date 



- \ 



Mr. John Doe ^ 

1414 Bluehlrd Avenu^“-~^ • . . 

,AaytQwn, Keiatucky 10101 ' 

Dear John; ' ’ / ‘‘ 

We are pleased to have an opportunity to contact yOu regarding your envlo^at 

since jLeavlng our school. We are cpoperating with all of the other schools In 

this area and the Kentucky^Bureau of Vocational^dueatljDn- to study nee^ 

for vocational and technical education, ,/ ^ 

Your resptfnaesy4a the enclosed questionnaire will help school staff^i^nbers 

BjaVa a rehllsilc rei^ew of i^at fon^r sttdents are now dplhg «d what kinds 
of tralnlrig ^grains nl^t be desired. It>l8 not necessayr for you to^^^ 
your t©r the, questionnaire since it has been preceded for objectivity 

during a^lyils.e ^ " 

Fleaae the ^closed envelops to rstum the quastloimalte by 0a 

Your cobpstatlon is greatly appreciated> / 

’ ■ ■ ■' ■ y - ■ , 



Supej/inteadent of Sc^ols or Teacher 



P 






SAMPLE 

Third Hailing tlrst Thaidt You-Hamlndar Card 



X,^ 



Pate 

We want to express our thanks for your cooperation In 
completing the questlonaalre rectetly sent to you. We 
hope to have some summaries made early in . (Month) _ « 

Sincerely^ 

' .\ ■ ^ ^ V ’ ' . ' ' 

Superintendent of Schools or Teacher 

P^S. If you have not, yet coti^leted the questionnaire, 
please cos^lete It and put It In the mall today. 
ThaidEe . ^ . 




% 












f* 



m 






i 



20 



SAMPLE 

Fourth Mailing ■*— Second -^quest Cover Letter 



(School Letterhead) 



Date 



Mr. John Doe ' > 

1414 Blileblrd Avenue , 
Any town p Kentucky 10101 



.# 



Dear John: 



The response to our request for information from meters of the 1963 class has 
been most gratifying. Tim return questlomialres are being analyzed by school 
staff members and we hope/ to pres ent a prellnd.nary report withlh the next 



three weeks. 



Perhaps the first questionnaire we sent to you has bem mislaid so we have 
enclosed another for your convenience. We hope to have all of our former 
studente respond so that the Information will be as complete as possible. 



Please use the enqlosed envelope to return ^e completed questloimalre today. 
Thank you for your cooperation. 



. / 
/ 









Superlnteadent of Schools 



■ /' 



^er!c 









SAMPLE 



Fifth Mailing — Second Thank You-Beasinder Card 



Date 



Your cooperation in returning the former student follow- 
up questionnaire is appreciated. The coiiq>leted questlon’- 
aairee have provided the school s^.£f with much valuable 
Information for developing a plan 'to. meet the vocational 
and technical education needs of youth In our area. 

Sincerely, j 



Stqperlntendent of Schools 

I 

P.S, Perhaps your questiomaaire is one of the «£av 
still not received. We hope it is now in the 
mall. Thanks, 
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A stamp^ds self-^addressad envelope should always accompany . the follow-up 
instrument and cover letter. 

Timing Is as Important In a follow-up study as It is to an announcement 
for political office or a fund-raising drive. There is a slight perference for 
the early part of the week; mailings should be timed so that items arrive on 
Monday or Tuesday, /"^oid periods of ^stress” such as the middle of April (in- 
coma tax time), vacation time, holidays ^ etc. When using a multiple mailing 



approach it makes sense to use a different strategy on the secon^ and third 

% - 

mailings. Some people are early-ln-the-week performers, others late-ln-the- 
week performers. If you tried to reach them early in the week on the first 
mailings, try for a week-end arrival on a subsequent mailing so the letter 
arrives on Friday or Saturday. Urge respondents to "do it now," The longer 
an instrument is kept, the less likely tt will be completed and returned. Re- 
mind them of the date by which the Instrument should be returned. 

Again, perhaps^the greatest emphasis should be placed on those former stu- 



dents who did not complete the program. Members of a conference on follow-up 

It 

studies in education research had this to . Bay i 



All agreed that those who require the most prodding before they 
will respond are generally those the programs are trying harder to 
help.- , ^ 



Cover letters should have letterheads and envelopes should have return 
addresses with which the former students can easily Ide’ntii^. The physical 



appearance of the materials sent to former students should be professional in 



layout and designed to arouse Intarast, 






^Judith S. Craig, Proceedings of the Conference on Follow-up Studies 
jh Educational Research (Madison: Center for Studies In Vocational and 

Technical Education, Industrial Research Institute, The University of Wisconsin, 

196|I^ P. ai. 
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LOCATING RESPONDENTS 

One of th^ most difficult problems in a follow-up study cars be locating 
respondents. One ^ of the beat methods of maximizing returns is the advance 
orientation of students who are to respond to instruments at a later date. Be- 
fore students leave your vocational education program it is a good Idea to 
acquaint them with the fact that they will receive a follw-up instrimant through 
the mall. Discuss with the students why this is being done. If at all possible 
expose them to the follow-up Instrunient so they can raise any questions they 



may h^ve. From the experiences of other researchers wa know this procedure 



ieW.ll greatly improve vour rate of returns. If soneone who knows the students 

■ N . 

explains what is eoming and why it is betnd done they are more likely to respond. 

During advance orientation it might.be well to provide students with ”We 
have moved'* , cards i pre-addressed to the former student ''s Instructor or school. 
Always have students list their parents addresses as contact for forwarding 



addresses. 

There is one serious danger with advance orientation. Teachers may ^ave 
the opportunity to introduce bias in the results by influencing student answers* 
However, the increased rata of returns greatly offsets this disadvantage. 

Following graduation there are other methods which can be used to fex'ret 
out the dapartmant former student , Sopae of these methods include: 

T, Writing..^4F^ase Forward** on, announcements and survey InsLrimients, 

2, Sending self-addressed chauge-of -address cards to parents of non- 
respondents so the parents can provide the current address, and 

\ ■ ■ ' 

3, Obtaining cooperation frm local news media (newspapers, radios, and 

TV) for public service announcements concerning the follow-up survey, 

Schwarzweller , in a study of former students in Eastern Kentucky, sent 
teams of **detectlvcs** to locate former students, Fieli^^'wbtlcers drove from com- 
initiitty to community interviewing school HupetintunUciUH, teacherH, parcuts, 
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relatives s neighbors, friends, post office clerks, store wners , and 

4 / 

schoolmates • / 

Another method of locating people is the local credit bureau* They cer^ 

talnly knotir how to keep up with people, hovrever this is an ^pensive process* 

ORGANIZING FOR THE STUDY 

Finally, make it easier on yourself and other staff members by organizing 
your projeGt so that you can telL on any oiie moment hcpw the study is progressing 
A helpful procedure is to make charts to include orientation procedures, con* 
ferences, mailing dates and dates for completion of various phases of the 
study. It may be more convenient to break the project into phases which can 
be completed within themselves without doing harm to the overall project. In 
planning the follow-up study it is wall to draw up a schedule of activities. 
Follcwing is an example of typical activities. 

SCHroULE OF ACTIVITIES 
Phase X - 
Preparation 

1. Develop objectives for the follow-up study, 

2, Determine the group or groups of former students to be involved In the 

follow-up study, , ■ 

3, Determine best method of cpndiictlng the follow -^up study: 

a . Ma i led que s t ionna ire 

b. " Periional interview 

c. Phone Interview 

4. Design questionnaire in consultation with; 

a. Administrators 



^Harry K. Sclwarzwell'er Research Design . Fie Id Work Procedures . and 
Peta Collection . Problems in a Follog-up Study -^ Young Men From Eastern 
Kentucky . (LexingtonrAgricultura^Experinient Station, University of Kentucky,, 

' ^ 1963)-. ■ ' ■ ■ ■ ■ “ - 

ERJC 
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b , Teachers 



c* Citizens advisory coimnlttee 



d* Student conmlttaa 



e. Board of education 



5. Ontain authorization for use of signatures from teachers or administrators 
who will be signing alert cards* cover letters* and reminder cards/ letters . 



7. Prepare master address file. 

Phase tl 
Data Gollection 

1. First mailing - alert cards. 

2. End of first week - second mailing - cover letters and questionnaires, 

3. First response analysis; 



b. Begin search for correct address (of instruments returned because 

of incorrect address) ) 

c. Compile address list for third mailing (non-respondents and corrected 
corrected address) 



6. Obtain addresses of former students. 



Begin running count of returned* completed questionnaires 



4, End of second week - third mailing 



a. Reminder cards for non-respondents 




e. Continue search for corrected address 



d. Prepare list for fourth mailing 

5. End of third week - fourth mailing 




a. Reminder letter and second copy of questionnaire to non-respondents. 

b. Continue response analysis 




f 



j . — 



6. End of fourth week - fifth and final mailing 

■ 

date to non-respondents. 

Phase III 
Analysis of Data 

1* Preparation of Follcw-up report 

a. Analysis of findings 

b. Non-respondent report 
2, Conferences with: 

Administrators 
b. Teachers 
c* Citizens 
e* Student committee 
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Renfinder card with cut-off 



e. Board of 



tion 



3* Publication of Followpup Report 

l CONCLUSION 

In conclusion^ we want to emphasize that former student follow-up studies 
constituta one of our mostj valuabfa techniquas for assessing education system 
outoomas. We must retn^ber that the results of a follow-up study should be 
combinad with Other findings to reach sound . recommendations . Follow-up studies 

can produce yalld and reliable findings useful in making sound educational 

i ■ ■ ■ 

decisions at the local » area, state, and national levels. 
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